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The integrate-and-fire type of dynamic neural networks are studied in models with hitherto ne- 
glected finite widths to make them more realistic. Pulse shapes of arbitrary widths and shapes 
are considered and differences in the evolving firing patterns are noted. The convergence to limit 
cycle is examined both analytically and in simulation experiments. We present a proof of a theo- 
rem regarding the timer period of oscillation analogous to that of Hopfield and Herz for nonleaking 
models with finite width action potentials. It is pointed out that the concept of simultaneity in such 
networks may be subject to bin widths, i.e. window apertures of cumulative counts, in simulation 
experiments. The relation to Kolmogorov complexity is briefly discussed. The effects of varying the 
shape of the action potential and its width are examined in some detail. The roles of the magnitude 
of a leaking resistance connected to the neurons, a common external current and synaptic currents 
between neighbors are also examined and found to bear important consequences in the dynamical 
development of the networks. 
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I. INTRODUCTION 

Models of neural networks are important to understand 
biological information processing and storage systems, 
and also because their relation to many physical systems 
shed new light on those nonbiological complexes. It is 
well-known that Hopfields associative memory networks 
[A J3 share many common features with spin glasses 
[3, 13 • Artificial neural networks may one day pave the 
way for creating computers which are more akin to or- 
ganic pattern recognition systems, and hence more effi- 
cient in tasks at present not addressable by mechanistic 
serial processing. 

Associative memory networks |E IE S IS ^| are 

usually conceived as static patterns holding memories of 
inputs, but in recent years there is growing interest in 
systems which too hold memories of inputs in a dynamic 
fashion, in the form of phase-locked oscillations. Several 
different type of models have been presented [T3.ll5| with 
different assumptions about their modus operandi. The 
differences may be in the ways the neurons are triggered, 
in the ways they convey their information to other neu- 
rons, in the fashion they are interconnected, and other 
conjectures about the role of the environment. 

Among these models are included a set of relatively 
simple networks of integrate-and-fire neurons conceived 
by Hopfield and Herz whose work shows that many 
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interesting nontrivial predictions regarding the dynamic 
behavior of such networks could be made from their sim- 
ple properties. However, in their work, to maintain sim- 
plicity, they assumed that the action potential is in the 
form of a delta function in time, i.e. it is instantaneous. 
But in some of the models they present, when a neuron 
fires on attaining threshold from part of the action poten- 
tial (AP) from a neighbor, the remaining excess charge 
from the neighbor may remains stored and contributes 
to the next firing of the receiver, which in a sense mimics 
the effects of a finite width, without involving quanti- 
tative complications that an explicit finite-width model 
would entail. 

A more realistic approach, however, cannot avoid deal- 
ing with all the consequences of the finite width of the 
AP, which is a biological fact and must also be an in- 
evitable feature of most physical realizations.^ priori, 
these may be in the form of changed periods, different 
convergence behavior to limit cycles or modified rates of 
convergence, different paths to globalization, or its ab- 
sence altogether etc. 

The width introduces its own time scale that can be 
expected to interact with the time scale of the zero- width 
period obtained in the H&H models, which in turn de- 
pends on the strength of coupling among the neurons 
and the environmental current. It also introduces the 
possibility of a more complicated distribution of the ac- 
tion potential current to the receiving neuron, affecting 
its attainment of threshold, i.e. its period and properties 
related to convergence to limit cycles. 

We have, therefore, investigated the consequences of 
introducing finite widths into the integrate-and-fire mod- 
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els. Where possible we have tried to use analytical meth- 
ods. Where that turns out to be impossible, we have 
used simulation. In the next section we first describe dif- 
ferent types of integrate-and-firc models to establish the 
concepts and notation used in this work. In section 3 
we show that the convergence to periodic behavior for 
Class C models can be analytically proved even in the 
finite width case. In section 4 we present our simulations 
with class C models using APs of various finite widths 
and different shapes. In section 5 we do the same with 
the leaking model A. Finally in section 6 we present our 
conclusions. 



II. INTEGRATE-AND-FIRE MODELS 

Integrate-and-fire neurons are usually considered in 
four different scenarios Q. In each case every neuron 
in the network receives some charge from other neurons 
in the neighborhood, and also from an environmental 
current source. This raises the electrostatic potential of 
the neuron. When the neuron has accumulated sufficient 
charge and its potential exceeds a threshold, it fires, i.e. 
it gives forth an AP to the other neurons, which too may 
be triggered in due course. If all neurons attain the same 
periodicity, the phase difference among them must be- 
come constant, i.e. the system becomes phase-locked. 
It is also possible for some of the neurons to fire simul- 
taneously (synchronicity) if they reach the limit cycle 
together. 

Let Ui{t) be the potential of the i-th neuron at time 
t, Ii(t) the external current input into this neuron, R its 
leaking resistance and Tijfj{t) the action current getting 
into neuron i from neuron j. We can then write the 
current conservation equation as: 

Cdu,/dt - -u,{t)/R + ^jT,,f{t) + hit) (1) 

For simplicity with no loss of generality we take the 
threshold for firing to be u = 1, by renormalizing u to the 
dimensionless quantity u / uthreshoid- We can also divide 
the equation by C and absorb it in R and /, in which case 
R actually represents Ci?, the decay time constant, and 
/ represents I / {Cuthreshoid) which has the dimension of 
inverse time. In other words, in our notation R and \/I 
will set two different time scales. In most of our work 
we shall assign the value 1 to / to represent the scale of 
an external clock against which all internal dynamics is 
timed. 

In the H&H work the action pulse shape f{t) is a Dirac 
delta function, i.e. it is a zero-width normalized pulse: 

f^{t)^6{t-t,) (2) 

where tj is the time of the last firing of neuron j. 

The four models differ in the treatment of the leaking 
as represented by R and in the way they handle the after- 
fire potential Ui. 



In Model A, R is finite and may be taken to be equal 
to 1. This establishes the time scale CR. In this model 
if neuron i receives a synaptic charge in excess of that 
required to take the potential to the threshold, then, after 
firing, Ui{t) resets to a value corresponding to the excess 
charge (we omit the implied symbol for summation over 
neighbors j for clarity) : 

u^{t+) = [u,{t-) + AT.jl] + (1 - A)ry = (1 - A)r,, (3) 
where 

mj = i-u,{t-) (4) 

In Model B, the potential resets to zero after firing, 
irrespective of the oncoming synaptic current and the 
previous state of the neuron. It too has a leaking i? = 1 . 
Model C is the version of A that does not leak, i.e. R ~ 

00, and Model D is the non-leaking version of B. 

One can integrate the model C potential since the last 
firing at Iq gives, assuming for simplicity constant exter- 
nal current /: 

u,{t)=u,{t+) + ^T,J+I{t~to) (5) 

where the summation is over only those other neurons 
j which have fired since io- 

It is convenient to use a simple topology of the network 
by assuming only nearest neighbor interactions. Then, 
after phase-locking has been established with period P, 
we must have: 

u{to+P) = l = ^jT,j+IP (6) 

So 

P={1^A)/I (7) 

where for notational convenience, assuming constant 
Tij, we get: 

A = SjTy = Za (8) 

Z being the co-ordination number of the neural lattice, 

1. e. the number of nearest neighbors. In Model A it is not 
possible to integrate Eq^ because the integral depends 
on the specific times the contributions from the differ- 
ent neighbors are received. This uncertainty results from 
the leakage, which is proportional to the instantaneous 
potential. 

III. CONVERGENCE TO PERIODICITY IN 
THE FINITE WIDTH CASE 

When the action potential occupies a finite width we 
have to use the pulse form factor / with 

pto+At 

/ dtfit) = 1 (9) 
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Here to is the time of the beginning of a firing and At 
is the width of the action potential and the consequent 
synaptic current. 

As in the case of zero width action potentials, we can 
show that in the finite width case too the system moves 
to a limit cycle with phase locking among the neurons. 
We shall do it for the nonleaking model C. We present 
the proof in three parts. 

I: The time between the beginning of two successive 
firings of the same neuron cannot be less than P = (1 — 
A)/ 1, where the variables are as defined in Eq. Qand Eq. 
il 

Proof: Let i be the neuron which has the smallest in- 
terval between two firings (there may be other neurons 
with the same least interval). Let the two firings begin 
at times ti and t2. Let us consider any neighbor j of i. 
Since, i has the least interval between successive firings, 
j cannot begin to fire twice within this interval. Hence, 
i can receive at most fractional charges from two firings 
of j within this interval, of which the beginning of the 
second firing t'2 can be within the interval, but not the 
earlier one t'l- So 



t2 ~ ti <■ t2 — t'l 



(10) 



1.6. 



t2 — t2 < ti — t'l 



E[t + P)- E{t) = E,[-u,(f + P)] - ^^[-u,[t)] 

rt+P 

Mt)dt 



IP YljTij 



-{1 - A)N + {1 - A)n 
= -(l-^)[7V_i], 



t+p 



h{t)dt 



t+p 



h{t)dt 



t+p 



Mt)dt] (15) 



(11) 



But no neuron can begin to fire twice in an interval of 
less than P; so E{t + P) — E{t) is nonpositive as in the 
case of zero width AP. Hence, like the zero width case, 
we have a convergence to a limit cycle. 

HL If there is a periodicity, the period must be P = 
(1 — A)/ 1. Proof: Firstly, by part 1, it cannot be less 
than P, because no neuron can ever begin to fire again 
within an interval less than P. Indeed if we now assume 
that a periodicity T has been established, i.e. all neurons 
have become phase locked with equal phase difference in 
all periods, then, if ti is the last time neuron i began to 
fire: u,(i,+T) = 1 = Y^jT,, j^^^ f,{t)dt + IT = A+[(l- 
A)/P]T. 

The last equality follows from the fact that if i receives 
a fraction of a pulse from a neighbor j at the beginning 
of the cycle, it will receive the rest at the last part of its 
cycle because of phase lock. i.e. /j*^^ fj{t)dt = 1 for all 
7. So T = P. 



The total contribution received from j by i within this 
interval is: 



IV. RATE OF CONVERGENCE TO LIMIT 
CYCLE 



fS2At 

a, = I f{t)dt 




At 



f{t)dt 



(12) 



si At 



where 

Sl,2 = (tl,2 - A.2)l^^- 

As, S2 < si, we see that 



(13) 



An interesting observation can be made for the speed 
of convergence to the limit cycle with period P. Let 
us consider, for simplicity, finite pulses of square shape. 
Then the contribution from a neighbor j to a neuron i 
will be proportional to the fractional duration of the pulse 
received by i within its (variable period) cycle. Again, 
for simplicity let us consider only one neighbor. Then, if 
P„ is the period of the n-th cycle, and /„ is the duration 
of the pulse received by i, and w is the width of the pulse, 
then 



(14) 



ensuring that the period for i. Pi > P. 
II: The system converges to a limit cycle for the finite 
width case: 

Proof: The Lyapunov function E is defined by £^ = 
—TiUi. Then its change after an interval P given by Eq. 
□ is 



P„+i - [l{A/w){w ~ /„) - AU+i/w]/I 
= Po + A/{wI)[U~fn+i] 



Now, writing 



we get 



AP„ = P„ - P 



APn+i/AP,,^A/[Iw + A] 



(16) 

(17) 
(18) 
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We can see that convergence to the hmit cycle is a 
geometric sequence and the rate of convergence depends 
on the Aj (Iw + A) ratio, which of course is dimensionless 
in our choice of notation. For fixed w a higher current 
would bring in faster convergence. It may seem that for 
the zero width case we have no convergence at all. But 
actually in this singular case we cannot split the pulse 
into two parts as in Eq. 1161 so that we must have /« = 1, 
and AP„ = for all n, i.e. the system goes into phase 
lock after the completion of the first set of firings. As 
we pointed out in the beginning, this relation is derived 
assuming a single neighbor, li Z > 1, then in general the 
different neighbors can contribute with different phase 
differences, which may keep changing until phase lock. 
Eq. El will then need to be modified to account for these 
differences. If r of the Z neighbors contribute fully within 
a single period, then we have: 

AP„+i/AP„ = A'/ilw + A') (19) 

where we have used the symbol 

A' ^{1- r/Z)A (20) 

Therefore, when all the neighbors contribute their full 
action potential within a single cycle, the period becomes 
P. However, the inverse is not true, i.e. it is possible 
to distribute the charge from a single AP to succeeding 
cycles of the neighbor and the whole system can still be 
in total phase-lock with period P, because the R.H.S. of 
Eq. 1191 becomes indeterminate. In the case of pulses of 
arbitrary shapes it is easy to see that we get: 

AP„+i =Sj(aj//)+ / " f{t)dt (21) 

where the sum runs over only those neighbors which do 
not yet deliver their full synaptic current in a single cy- 
cle. This is an integral equation depending on the shape 
function f{t). Despite the arbitrariness of f{t) we can see 
that if AP„-(-i — > AP„, then both must approach zero, 
i.e. the sequence must be convergent to the limit cycle. If 
AP„_|_i/AP„ — > r < 1, then too the convergence is obvi- 
ous. If as a first approximation we replace the arbitrary 
pulse by a square one of same height but a width giving 
unit area, then we would expect a geometric convergence 
similar to Eall8t Eq. 1201 The details of the pulse shape 
may produce smaller perturbations on the rate of con- 
vergence without affecting the general pattern. 

V. NONLEAKING NETWORKS WITH FINITE 
WIDTH A.P. 

We simulate a square lattice with periodic boundary 
conditions to reduce finite size effects. It has been noted 
that a 40 X 40 lattice is sufficient to demonstrate all the 



important characteristics. At each step the neurons are 
updated according to the charge they receive from their 
neighbors and the external current during the time loop 
and then, if the potential reaches threshold, it fires. The 
effect of the finite width of the action potential can be 
two-fold: (1) reduction of u over a number of time loops 
corresponding to the width of the AP after a neuron be- 
gins to fire, and (2) the arrival of the synaptic current 
Tijf{t) over a number of time loops according to the 
shape of the packet f{t). We do not expect any role 
for ectopic pulses resulting from recharging to threshold 
before the previous firing is completed, though the synap- 
tic current arriving at a neuron while it discharges will 
be retained for the next firing. Hence, in the nonleaking 
models it is unnecessary to model the actual shape of the 
fall of u. The results will be indistinguishable from those 
of a zero-width model in such models, though the situa- 
tion in leaking models will be quite different because the 
leakage will depend on the falling potential. The distri- 
bution of the synaptic current over multiple time loops, 
however, will carry the nontrivial differential character- 
istics of finite width action potentials in all models. In 
this section we consider only a nonleaking model. We 
have in our algorithm provision for generating pulses of 
various shapes in the form of discretized f{ti) over the 
time loops during which the action pulse works. Arbi- 
trary shapes can also be given as input. However, we 
have only done the simulations with square and isosceles 
triangular shapes for simplicity. 



A. Effect of Pulse Shape: 

In Fig^ and Fig. |2 we present our simulations with 
A = 0.96 (i.e. Tij = 0.24), / = 1 and width = 0.01 
(which is 1/4 of P) using first a square pulse (Fig^l, and 
then a triangular one (Fig|2Jl. We note that indeed in 
both cases the period 0.04 is equal to P[= {1 — A)/I], as 
proved earlier. However, there is a slight difference be- 
tween them in their rate of convergence to the limit cycle; 
the square pulses almost converge after t = 4, whereas 
for the triangular ones a similar level of convergence hap- 
pens after t = 6. This can be expected on account of the 
simplicity of the square pulse allowing it to adapt itself 
more easily for phase-locking. 



B. Convergence Rate and the Value of A: 

In Fig|3|and Fig^lwe show the effect of changing the 
value A, keeping the same ratio of the width with the 
corresponding period P. Fig|31is for a square pulse and 
Figgis for a triangular one. Of course varying A changes 
the period. But we have also seen that the rate of con- 
vergence depends on the relative magnitudes of A, I and 
w according to Eall8I Eq. [2] A higher contribution 
from the neighboring neurons than the constant exter- 
nal driver seems to delay convergence, which may be 
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FIG. 1: Square pulse with width w = 0.01, A = 0.96, 1 = 1. 
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time 

FIG. 2: same as Fig. 1, but with a triangular pulse. 



expected on account of the more intricate interactions 
in phase adaptation of the neighboring neurons than in 
their susceptibihty for acting cohesively with a common 
external driver. For A = 0.24, i.e. a = 0.06, we get prac- 
tically immediate convergence after all the neurons have 
fired for the first time. This feature is common for both 
shapes of pulses. 



C. EflFect of Region of Initial Excitation: 

The network can be made to receive an initial exci- 
tation at the periphery, or throughout the network. In 
Figl^lwe repeat the experiment of Fig[21 with the same 
parameters, but with only the peripheral neurons ini- 
tially excited. We see that the general pattern remains 
the same, and cannot be distinguished from the whole net 
excitation of Fig. |21 However, in Fig. |Hlwe have done the 
same with the smaller A{= 0.24) case, first studied with 
whole net excitation in Fig0] There is remarkable syn- 
chronicity in this case, the great majority of the neurons 
firing together periodically. We can understand what is 
happening here if we picture the initial development of 
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FIG. 3; Square pulse, with A = 0.24, / = 1, w; = 0.2 
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FIG. 4; same as Fig. 3, but with a triangular A. P. pulse. 



the system. All the inner neurons are initially uncharged 
and they do not receive pulses from neighbors until their 
first firing at t = 1, which is caused simultaneously by 
the common driver /. Henceforth, all these inner neurons 
remain phase locked. By contrast for A — 0.96, the ex- 
ternal current has little role in charging up the neurons, 
and hence the neurons get phase-locked only after their 
mutual interactions, making the situation similar to the 
whole net excitation. 



VI. SYNCHRONICITY, BIN SIZE AND 
DYNAMIC ENTROPY: 

While the synchronicity just described, induced by 
the common external agent, may indeed be genuine, the 
other synchronicities may be more suspect. Since in sim- 
ulation experiments the time loops must occur after a 
small but finite duration, the procedure puts many events 
of different exact times in the same bin. This is revealed 
if we change the bin size in the experiment. Neurons 
which appear in the same bin seem to split up when the 
resolution is increased. In Figdwe show the results of 
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FIG. 5: As Fig. 2, but with peripheral initial excitation. 

800 
700 
600 



g> 500 
S 400 
§ 300 
200 
100 




LJ 



1 2 3 4 5 
time 

FIG. 6: As Fig. 4, but with peripheral initial excitation. 



lumping 10 loops of Fig[21into one loop. Apart from the 
proportionately higher bin counts, convergence also ap- 
pears to arrive faster, which of course is only an artifact. 




3 3.02 3.04 3.06 3.08 3.1 3.12 3.14 3.16 
time 

FIG. 7: As Fig. 2, but with a time step 10 times greater. 

Because of the built-in time scales related to charg- 
ing rate, affinities with nearest neighbors, and the width 
of the action pulses, it is not expected that such neural 



networks would show self-similarity, i.e. a fractal struc- 
ture. It is obvious that if the time bin size is made small 
enough, the amplitude, i.e. the number of firings per 
bin, would normally be reduced to a sequence of units 
and zeros, though, because of the discrete nature of the 
upgradings in a computer simulation, there may be oc- 
casional coincidences. A two-letter alphabet can then 
define any time sequence of an arbitrary length. 

In a time series Kolmogorov-Sinai entropy 0, 0| is 
occasionally used as a characteristic measure of complex- 
ity of the series. It is a measure of the size of the algo- 
rithm needed to reproduce the series. A completely ran- 
dom sequence has infinite K-S entropy, a chaotic system 
has finite entropy, and a completely periodic system has 
zero entropy. The latter follows from the fact that in 
amplitude space the trajectory of the system follows the 
same path repeatedly; for a sequence of N such steps: 



Kn = 



E 



,) (22) 



lO,Jl,...,JiV 



and hence for a phase-locked periodic system, only a 
particular sequence of amplitudes {iq, ii, lAr} will have 
probability 1, and all other sequences will have probabil- 
ity zero, giving zero Kn and hence zero K-S entropy. The 
K-S entropy is the difference 



S 



KS 



lim 



{K, 



N+l 



K 



N 



(23) 



where e is the size of size of a unique state in the em- 
bedding phase space. In this case since we have a dis- 
crete phase space with integral amplitudes, and hence 
the transition e ^ is also discrete. A chaotic or ran- 
dom case might produce problems in such a case, but not 
in a purely deterministic situation as this one. 

Entropy would be null irrespective of the complexity of 
the pattern, and simplifying the pattern by summing bins 
together in any well-defined nonrandom fashion would 
not change the entropy from its null value. 

For the initial time domain containing the transition 
to the phase-locking state, since the system is fully de- 
terministic, despite the apparent random pattern of the 
firings it follows a unique trajectory, given a unique ini- 
tial state, and hence there is only point in A'^-dimensional 
or in -t- 1-dimensional embedding space with nonzero 
probability, again giving zero entropy. 



VII. LEAKING NETWORKS WITH FINITE 
WIDTH A.P. 

In FiglSlwe have shown the results of simulating a neu- 
ral network similar to that of Fig. [21 but with a finite 
value of the leaking resistance R. Compared to Fig. [21 
we see a higher time period T = 0.047, though in this 
case the convergence seems to have taken place much 
earlier at t = 1.7. For i? = 2, we get T = 0.069, and 
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the limit cycle seems to appear only around t = 3.5. The 
smaller resistance of course dampens the charging more 
and this results in the higher time period. It also effec- 
tively reduces the effect of the charging external current 
I and, as we have commented earlier, this weakening of 
a common driver increases the role of the complex phase 
adjustments of the neighbors, which in turn delays the 
convergence to the limit cycle. If we integrate Eq. ^ 
assuming like H &H that all the synaptic current from 
the neighbors arrive at the beginning of the cycle, and 
that we have narrow widths as a first approximation, but 
keeping R as a free time scale, we get 



TABLE I: Time period for leaking networks 




FIG. 8; As Fig. 2, but with leaking neurons with R — 10. 



T = R\og[{IR - A)/{IR - 1) 



(24) 



Again, this is derived assuming that each neuron gets 
the full synaptic current from the neighbors at the very 
beginning of the cycle and a narrow width as in H&H. 
We notice that though IR is a dimensionless quantity 
here, the period T is controlled by the scale of R if IR 
is constant, i.e., if we vary both / and R keeping IR 
constant, then 



T1/T2 = R1/R2 



(25) 



So, for 1=1 which we have used throughout as an 
external time scale reference, making R = 1 should give 
a singularity. Indeed when we tried to simulate a net- 
work with 7=1 and R = 1, not a single neuron fired. 
However, if we change R to a slightly higher value, e.g. 
R = 1.0001, other parameters remaining identical, we 
see a very interesting phenomenon. The neurons now get 
sufficient accumulated charge from their initial random 
charges, the external current and the synaptic current 
from neighbors to defeat the damping of the potential 
due to leakage and reach firing threshold. However, as 
the damping is severe near the critical value R=l, the dif- 
ferentiation of the initial phases becomes relatively unim- 
portant and many neurons move towards synchronicity. 



R 


1.2 


1.5 


2.0 


5.0 


10.0 


Tf ormula 


0.22 


0.11 


0.078 


0.050 


0.044 


T,„^[w = 0.001] 


0.095 


0.078 


0.068 


0.051 


0.048 


Ts^mH = 0.002] 


0.21 


0.11 


0.077 


0.049 


0.045 



In Fig. iniwe see the first bunch of firings, with some dis- 
persion, whereas in Fig II 01 which gives a more extended 
picture, the synchronicity appears to become more estab- 
lished in successive firings. This is in contrast to the case 
of weaker damping (FiglSJ described above, where peri- 
odicity establishes phase-locking, but not synchronicity. 
Eq. 131 seems to be more accurate for large R with small 
T, than for small R near criticality (Table 1). 
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FIG. 9: First firing of a net of leaking neurons, with a resis- 
tance just above the critical value of i? = 1. 




FIG. 10: As above, showing successive peaks with growing 
synchronicity. The first firings shown in detail in the previous 
figure are the small clump at around t = 2.8. 

It is understandable that for large periods the discrep- 
ancy between Eq. |^ and the results of the simulation 
increase. The neighboring neurons can then distribute 
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their synaptic contributions over a larger duration, and 
any signal arriving late is attenuated by R less than those 
arriving at the beginning of the cycle, which we have as- 
sumed. So, for large T, the effective A in Eq. |^is higher 
than the real A, which decreases the period to some ex- 
tent. We also note that if the width of the synaptic cur- 
rent pulse is changed there may be a change in the period, 
because a wider pulse is more liable to get attenuated by 
the damping R. The last row of the table presents the 
results of simulating with w ~ 0.002, which gives almost 
perfect agreement with Eq. |31 

VIII. CONCLUSIONS 

In this work we find that many of the results of an 
over-simple zero- width integrate-and-fire neural network 
are valid for more realistic finite-width models . We have 
proved analytically that even with a finite width, the 
system converges to a limit cycle with a period iden- 
tical to the zero-width case. However, the problem of 
convergence is more complicated for the case of finite 
width AP spikes, and we have shown that probably only 
asymptotic convergence ensues as a geometric sequence. 



which depends on the parameters of the model, i.e. the 
width, the external current and the synaptic coupling 
with the neighbors. The shape of the pulse does not seem 
to be the determining factor in controlling convergence, 
though it might have some perturbative modifications. 
The question of synchronicity seems to be complicated 
by the inevitable finitcness of the time steps in a simu- 
lation and opens up the possibility of investigating any 
fractal properties associated with such networks. The 
radical difference between peripheral and whole net exci- 
tation also seems interesting and worth further investiga- 
tion. Stochastic and mean field approximations may give 
analytic results where exact methods may be limited, as 
in the case of leaking neurons, though the simple formula 
Eq. I^for the period, derived with drastic assumptions 
give remarkably accurate predictions. The transition to 
sharp synchronicity in almost critically damped networks 
may therefore be amenable to more precise analysis. 
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